Mutant Reduction Evaluation: What is There and What is Missing?
نویسندگان
چکیده
Background. Mutation testing is a commonly used defect injection technique for evaluating the effectiveness of test suite. However, it usually computationally expensive. Therefore, many mutation reduction strategies, which aim to reduce number mutants, have been proposed. Problem. It important measure ability strategy maintain suite evaluation. existing evaluation indicators are unable “order-preserving ability”, i.e., what extent score order among suites maintained before and after reduction. As result, misleading conclusions can be achieved when using evaluate effectiveness. Objective. We propose ability” strategy, but missing in our community. Method. Given on Software Under Test (SUT) with set original we leverage generate group that partial relationship detecting ability. When first construct two relationships generated terms score, one mutants another reduced mutants. Then, under remains unchanged The more unchanged, stronger Order Preservation ( OP ) is, effective is. Furthermore, Effort-aware Relative EROP how much gain provide compared random strategy. Result. experimental results show able efficiently they better distinguish various strategies indicators. In addition, find Subsuming Mutant Selection (SMS) Clustering (CMS) than other EROP. Conclusion. suggest, researchers, should mutant practitioners, SMS CMS given priority practice.
منابع مشابه
P-value: What is and what is not
The misinterpretation and misuse of p-value have been increasing for decades. In March 2016, the American Statistical Association released a statement to warn about the use and interpretation of p-value. In this study, we provided a definition and discussion of p-value and emphasized the importance of its accurate interpretation.
متن کاملWhat Is Applied Literature?
Applied literature is a term that is the outcome of a need to put literature to tangible uses in the “real” world. A medical practitioner looking for a definition of life, for instance, finds literature a useful source for the answer. With paradigm shifts in scientific studies, interdisciplinarity has been a method to overcome the alienations that resulted from the isolation of disciplines from...
متن کاملWhat is Ethics of Science and Technology?
Background: The existence of crises and problems such as non-compliance with standards and professional ethics in the field of engineering and technology, and existence of fraud and misuse in the field of science has resulted in importance of ethics in the science and technology. But the fact is that there is no accurate understanding of the ethics of science and technology, and this field is o...
متن کاملEditorial: What Is Brain Mapping?
G20 World Brain Mapping Initiative (Neuroscience/N-20) is Putting Brain Mapping on the top of Global Economic Issues The Society for Brain Mapping, Therapeutics, and Brain Mapping Foundation are propelling therapeutic advances in Nano-Neurosurgery, Nano-Bio-Electronics, Artificial Intelligence, Neuro-Supercomputing and ‘cross-pollination’ among the bio-medical sciences and engine...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: ACM Transactions on Software Engineering and Methodology
سال: 2022
ISSN: ['1049-331X', '1557-7392']
DOI: https://doi.org/10.1145/3522578